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Postlingually acquired hearing impairment (HI) is associated witli changes in the representa- 
tion of sound in semantic long-term memory. An indication of this is the lower performance 
on visual rhyme judgment tasks in conditions where phonological and orthographic cues 
mismatch, requiring high reliance on phonological representations. In this study, event- 
related potentials (ERPs) were used for the first time to investigate the neural correlates 
of phonological processing in visual rhyme judgments in participants with acquired HI and 
normal hearing (NH). Rhyme task word pairs rhymed or not and had matching or mis- 
matching orthography. In addition, the inter-stimulus interval (ISI) was manipulated to be 
either long (800 ms) or short (50 ms). Long ISIs allow for engagement of explicit, top-down 
processes, while short ISIs limit the involvement of such mechanisms. We hypothesized 
lower behavioral performance and N400 and N2 deviations in HI in the mismatching rhyme 
judgment conditions, particularly in short ISI. However, the results showed a different pat- 
tern. As expected, behavioral performance in the mismatch conditions was lower in HI than 
in NH in short ISI, but ERPs did not differ across groups. In contrast, HI performed on a par 
with NH in long ISI. Further, HI, but not NH, showed an amplified N2-like response in the 
non-rhyming, orthographically mismatching condition in long ISI. This was also the rhyme 
condition in which participants in both groups benefited the most from the possibility to 
engage top-down processes afforded with the longer ISI. Taken together, these results 
indicate an early ERP signature of HI in this challenging phonological task, likely reflecting 
use of a compensatory strategy. This strategy is suggested to involve increased reliance on 
explicit mechanisms such as articulatory receding and grapheme-to-phoneme conversion. 
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INTRODUCTION 

Over the recent decades there has been a steady aging of the world's 
population, a trend that is expected to continue throughout this 
century (Lutz et al., 2008). Hearing impairment (HI) is tightly 
linked to age and consequently there will also be a steady increase 
in the number of people living with a hearing loss. In most cases 
HI is acquired after the important years in childhood when spo- 
ken and written language are established. In these circumstances, 
phonological abilities have usually had the chance to develop 
normally, which is not the case when hearing loss is prelingual. 
However, when auditory functions decline, changes may occur in 
the neural processing and representation of sounds. For example, 
several studies have found that acquired HI has a negative effect on 
phonological awareness as measured by visual rhyme judgment. 
Such results indicate that the representations of speech sounds in 



Abbreviations: BestEarPTA, best ear pure tone average; EEG, electroencephalo- 
gram; ERP, event-related potential; fMRI, functional magnetic resonance imaging; 
FP, frontal positivity; HI, hearing impaired group; IPG, inferior frontal gyrus; ISI, 
interstimulus interval; NH, normal hearing group; O— , orthographically dissim- 
ilar; O-h, orthographically similar; PSTG, posterior superior temporal gyrus; R— , 
non-rhyming; R-t-, rhyming; SMG, supramarginal gyrus. 



long-term memory, i.e., phonological representations, may grad- 
ually deteriorate when hearing is compromised (Lyxell et al, 1994, 
1998, 2003; Andersson and Lyxell, 1998; Andersson, 2002; Lee et al, 
2007; Lazard et al, 2010, 2011; Ronnberg et al, 2011). 

However, only two brain imaging studies have investigated the 
neural correlates of visual rhyme judgment in deafened adults 
(Lazard et al., 2010, 2012). Both used functional Magnetic Reso- 
nance Imaging (fMRI) to examine whether preoperative phono- 
logical processing could predict outcome of cochlear implantation. 
Results showed that the hearing-impaired participants either relied 
on the same, dorsal phonological route as the participants with 
normal hearing (NH), or they activated a ventral temporo-frontal 
route, including increased activation in anterior, triangular, parts 
of the left inferior frontal gyrus (IPG). This area has been linked to 
semantic access, while the opercular part of the left IFG has been 
associated with phonological manipulation such as grapheme-to- 
phoneme conversion and subvocal rehearsal (Jobard et al., 2003; 
Vigneau et al, 2006; Aparicio et al., 2007). The authors suggested 
that activation of the ventral route reflected a more global seman- 
tic strategy, in spite of the phonological demands inherent in 
the task (Lazard et al., 2010). In addition, the right posterior 
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superior temporal gyrus/supramarginal gyrus (PSTG/SMG), an 
area normally involved in processing of environmental sounds, 
was activated significantly more in the hearing-impaired partici- 
pants compared to the participants with NH (Lazard ct al., 2010). 
The right temporal recruitment increased with duration of hearing 
loss and showed a negative correlation with rhyme judgment per- 
formance. These results were interpreted to indicate a functional 
reorganization in response to auditory deprivation. With reference 
to studies showing that cross-modal plasticity in auditory speech 
areas of the brain can lead to an enhanced receptiveness to visual 
linguistic input following acquired hearing loss (Lee et al, 2007; 
Champoux et al., 2009), the authors suggested that right lateral- 
ized temporal areas are recruited for phonological processing as 
left-lateralized temporal regions become more responsive to visual 
information (Lazard et al., 2012). 

Hence, both behavioral and fMRI data indicate certain long- 
term changes in phonological processes following postlingual 
hearing loss, changes that are related to representations of sound 
stored in semantic long-term memory and neural plasticity rather 
than the on-line distortion of auditory input per se. The purpose of 
the present study was to take advantage of a method with high tem- 
poral resolution, event-related potentials (ERPs), to examine the 
time-course of phonological processing in visual rhyme judgment 
of individuals with acquired HI. 

Event- related potentials have proven to be an important tool in 
the study of language processes. The N400, a centroparietal neg- 
ativity peaking at around 400 ms after stimulus onset, is perhaps 
the most intensely studied language related ERP component (Bar- 
ber and Kutas, 2007; Kutas and Ledernieier, 2011). Stimuli that are 
incongruent in a particular context elicit larger (more negative) 
N400 amplitudes than congruent stimuli. The N400 is contingent 
upon both the stored representation itself and the retrieval cues 
provided by the context and its amplitude is enhanced whenever 
extra allocation of resources is required for access and integration 
(Barber and Kutas, 20'^-; ' ' al., 2008). A number of stud- 
ies have investigated phonological processing by examining ERPs 
elicited during visual rhyme judgments. The N400 is consistently 
amplified in non-rhyming as compared to rhyming conditions 
(Polich et al, 1983; Rugg, 1984a,b; Kramer and Donchin, 1987; 
Rugg and Barrett, 1987; VVcber-Lox et al., 2003; Khateb et al., 2007, 
2010). This phonological N400 has been interpreted as a marker 
of mismatch between the phonology of a presented stimulus and 
that of the expected/selected candidates momentarily available in 
short-term memory (Khateb et al., 2007). 

A few ERP studies have manipulated both phonology and 
orthography by using word pairs that rhyme (R-F) or not (R— ) 
and are orthographically similar (0-I-) or dissimilar (O— ) (Polich 
et al., 1983; Kramer and Donchin, 1987; Rugg and Barrett, 
1987; Weber-Fox et al, 2003). The visual, orthographic, cues 
either match (R-I-0-I-, R-0-) or mismatch (R-I-0-, R-O-L) 
the phonological cues. In participants without communicative 
disabilities the effect of phonological and orthographic mis- 
match is additive: the N400 is consistently largest in response 
to non-rhyming, orthographically dissimilar word pairs (R— O— , 
e.g., shirt - witch), intermediate in the mismatching conditions 
(R-l-O— , e.g., moose - juice, R— 0-I-, e.g., some - home), and 



smallest in response to rhyming word pairs that are orthograph- 
ically similar (R-I-0-I-, e.g., load - toad). Consequently, the com- 
ponent can be used as an index of normal brain functioning 
against which specific populations with phonological process- 
ing deficits can be compared. For instance, N400 attenuation 
and onset delay suggest reduced processing efficiency and slower 
processing, respectively, and both have been found in individu- 
als with dyslexia (Ackerman et al, 1994; McPherson et al., 1996, 
1998). To our knowledge it has not previously been investigated 
whether acquired long-term severe HI impacts the phonological 
N400. 

Earlier ERP markers of orthographic and phonological pro- 
cessing in silent reading paradigms, the N2-negativities, appear at 
around 200 ms after stimulus onset. For example, studies have 
found enhanced N2-like responses to homophonicaUy related 
word pairs (e.g., plain - plane; Niznikiewicz and Squires, 1996), 
presentation of syllables that violate expectations (e.g., judging 
whether the syllable "com" was included or not in the expected 
word "botte"; Proverbio and Zani, 2003), words orthographi- 
cally but not phonologically incongruent to expected words (e.g.. 
The ship disappeared into the thick phog [fog]; Newman and 
Connolly, 2004; Vissers et al., 2006), words violating phonologi- 
cal expectancy (e.g., Rob looked at his watch to check the skull 
[thyme, tyme, or time]; Savill et al., 2011) and to pseudowords 
as compared to unpronounceable letter strings and real words 

(Simon et al., 20( ; , 2006). These negativities have 

been interpreted as reflecting detection of conflict between out- 
puts of orthographic and phonological analyses (Niznikiewicz and 
Squires, 1996), phonologically based lexical retrieval (Simon et al., 
2004), or violation of orthographic form expectations (Newman 
and Connolly, 2004). 

Event-related potentials effects in this early time-window have 
hitherto not been reported in visual rhyme judgment studies. It 
needs to be noted that few of these studies report whether early 
time-windows, i.e., before around 300 ms after stimulus onset, 
have been analyzed. However, the sensitivity of N2-like negativi- 
ties to conflicts between phonology and orthography renders them 
interesting in relation to visual rhyme judgments made by individ- 
uals with HI. Typically, HI has no impact on performance when 
the visual cues provided by the orthography aid rhyme judgment. 
It is specifically when the phonological and orthographic cues 
conflict, for example when words look alike but don't rhyme (e.g., 
some - home) , that individuals with HI do significantly worse than 
individuals with NH. 

Sentences that are syntactically incorrect elicit a late positiv- 
ity, the P600 (for reviews, see Kiiperberg, 2007; Van Petten and 
Luka, 2012). In language studies, late positive-going modulations 
are generally thought to reflect a continued analysis or reanalysis 
following violations of linguistic predictions or rules (Federmeier 
et al., 2007; Kuperberg, 2007; van de Meerendonk et al., 2010). 
Although mainly studied in relation to syntactic processing, the 
P600 can also be elicited by orthography/phonology conflicts. For 
instance, Vissers et al. (2006) found an enhanced P600 in response 
to pseudohomophones of highly predictable words (e.g.. In that 
library the pupils borrow bouks [books]). Liu et al. (2011) used 
lines from well-known Chinese poems in which one word had 
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been substituted with either a synonym, i.e., a word semanti- 
cally congruent but phonologically incongruent to the expected 
word, or a homophone, i.e., a word semantically incongruent but 
phonologically congruent to the expected and found larger P600 
in the synonym condition. In the study by Savill and Thierry 
(2011) the P600 differentiated between homophones and non- 
homophones (e.g., horce-horse versus horle-horce) in controls 
but not in dyslexics. 

As is the case with the early negativities, late positivities are 
typically not reported in rhyme judgment studies. An exception is 
an early study by Rugg { 1 984a) in which a late positive component 
(referred to as LPC) was found to be sensitive to phonological 
congruency in terms of its peak latency. The latency was signifi- 
cantly shorter in response to rhymes than non-rhymes in words 
and non-words, an effect the author interpreted as an index of 
the extra time required to evaluate and categorize phonologically 
incongruent stimuli. Thus, any hearing related difficulties in the 
rhyme judgment task could also be reflected by deviations in the 
late positivities. 

The work of Neely and colleagues (Neely, 1977; Neely et al., 
1989) has established that contextual cues can facilitate access 
to stored lexical representations via both implicit and explicit 
processes. When < 500 ms separates the onsets of a prime and 
a target word, facilitation is predominantly mediated by implicit 
spreading of activation in the neuronal semantic long-term mem- 
ory network. Longer latencies between prime and target onsets 
allow for involvement of explicit expectancy strategies (Neely, 
1977; Neely et al, 1989; Baum and Leonard, 1999; McQueen and 
Sereno, 2005). Sets of potential targets with a task-relevant relat- 
edness to the prime are generated. When the presented target is 
consistent with the prime, demands on strategic lexical search and 
access processes are reduced. However, when the target is inconsis- 
tent with the prime, the expectancy set needs to be inhibited and 
attention shifted to the presented target (Neely, 1977; Lau et al., 
2008). 

In recent years, a growing body of research has pinpointed 
the important role of top-down influences in language process- 
ing when audition is compromised. For example, access to explicit 
resources in the form of good working memory capacity is asso- 
ciated with better speech recognition under chtJlenging listening 
conditions (Lunner, 2003; Gatehouse et al, 2006; Foo et al., 2007; 
Lunner and Sundewall-Thoren, 2007; Rudner et al., 20 1 1 ) and sup- 
ports performance in phonologically demanding tasks (Classon 
et al., 2013) in individuals with HI. 

With respect to the present study, the poorer quality phonolog- 
ical representations associated with HI are likely to interfere with 
implicit spreading of activation to phonologically related lexical 
representations. Engagement of explicit top-down processes might 
then provide an important compensatory pathway to lexical access 
(Ronnberg et al., 2008). If so, markers of sublexical phonological 
processes and phonologically mediated lexical access should devi- 
ate more under conditions where implicit priming is the dominant 
process as compared to conditions allowing explicit mechanisms 
to kick in (Ronnberg et al., 2010). 

The aim of the present study was to investigate the effects of 
HI on the ERP correlates of phonological processing. Participants 
with postlinguaUy acquired moderate-to-severe HI for at least 



10 years and a NH control group performed a visually presented 
rhyme judgment task in four conditions: two matching (R-l-O-l- 
and R— O— ) and two mismatching (R-l-O— and R— 0-I-). The 
inter-stimulus interval (ISI) was either short (50 ms, i.e., 250 ms 
between word onsets) or long (800 ms, i.e., 1000 ms between word 
onsets) to investigate if behavioral performance and/or ERP cor- 
relates differed as a function of the possibility to engage top-down, 
explicit processes. These ISI's were chosen because they represent 
intervals frequently studied in the literature on implicit/explicit 
facilitation (e.g., Neely, 1977; McQueen and Sereno, 2005; Lau 
et al, 2008). 

We hypothesized that the neural response of participants with 
HI would be different from that of NH participants in N400 
amplitude and/or peak latency in the mismatching rhyme task 
conditions. In addition we expected any N400 difference between 
the groups to be larger in short ISI than in long ISI because the lat- 
ter leaves more room for engagement of compensatory processes. 
We also expected HI to be associated with a larger sensitivity to 
conflicts between orthographic and phonological cues as reflected 
by enhanced N2-like responses in the mismatching rhyme con- 
ditions. Lastly, we chose to analyze a time-window following the 
N400 to capture any late positivities sensitive to hearing status. 

MATERIALS AND METHODS 

The data reported below were collected as part of a larger study 
which included a test battery to assess auditory and cognitive func- 
tion and an off-line episodic recognition memory test. The pri- 
mary focus of this article is the behavioral and ERP data collected 
in a rhyme judgment task. 

PARTICIPANTS 

Fifty-three adults participated in this study. They were all native 
Swedish speakers and reported normal or corrected to normal 
vision, no psychiatric or neurological disorders, and no history of 
reading disability. All were right-handed except for one participant 
with NH. Twenty-six individuals (12 women) with a mean age of 
63 years (SD = 6.50) were recruited from the audiological clinic 
at Linkoping University Hospital. All had postlinguaUy acquired 
moderate-to-severe sensorineural hearing loss (HI) . Mean best ear 
pure tone average measured across 500, 1000, 2000, and 4000 Hz 
(BestEarPTA) was 72.27 (SD= 10.12, range 59-109). The mean 
duration of hearing loss was 36 years (SD= 12.07, range 10-61) 
and mean age at hearing loss onset was 26 years (SD = 13.32, range 
4-53). Duration and age of onset were self-reported responses to 
the question when they first became aware of having a hearing 
problem. All were bilaterally fitted with hearing aids and the aver- 
age length of time since fitting was 19years (SD= 11.50, range 
3-47). 

Twenty-seven ( 1 1 women) individuals with NH, here defined as 
a BestEarPTA of <26 dB hearing loss, were recruited from the gen- 
eral population and constituted the reference group (NH). Their 
mean BestEarPTA was 14.42 (SD = 6.52, range 3-25) and mean age 
62 (SD = 8.22). There was no difference between the two groups 
in age. 

The study was approved by the regional ethics committee 
in Linkoping (Dnr 77-09) and all participants provided written 
informed consent before testing started. 
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GENERAL PROCEDURE 

Participants were tested at two separate occasions. In the first ses- 
sion, background data were collected and the participant took 
part in the ERP experiment. After this, an episodic recognition 
memory task and the test battery assessing cognitive abilities were 
administered. The test battery included tests of word comprehen- 
sion ("Ordforstaelse B," Word comprehension B; Jarpsten, 2002), 
phonological short-term memory (digit span forward), working 
memory capacity (Reading span; Ronnberg et al., 1989), non-word 
reading ("Ljuden ger orden," The sounds give the word; dberg 
and Wolff, 2003 ), orthographic word-pseudohomophone discrim- 
ination ("Bokstaverna ger ordet," The letters give the words; 
Lundberg and \A'()l£f. 2003) and semantic and phonemic verbal 
retrieval (category and letter fluency; Benton, 1 968) . These tests are 
described in detail elsewhere (Classon et al., 2013, under revision). 
Total length of first the session was approximately 4 h, including 
time for applying and removing the ERP net and 30 min break 
after the recognition task. The rhyme task took around 40 min to 
complete. In a second session an experienced audiologist collected 
audiograms and speech reception thresholds (using Hagerman 
sentences; Hagerman and Kinnefors, 1995) from all participants. 

EXPERIMENTAL MATERIALS, RHYME JUDGMENT TASK 

Rhyme task stimuli consisted of 192 word pairs of which 48 were 
orthographically similar rhymes (R-|-0-|-, korp - torp, [kar:p] - 
[tar:p] ), 48 orthographically dissimilar rhymes (R-|-0— , helg-valj, 
[hel:j] - [vel:j] ), 48 orthographically similar non- rhymes (R— 0-I-, 
sant - saft, [san:t] - [saf:t]) and 48 orthographically dissimilar 
non- rhymes (R— O— , brod-spik, [bro:d] - [spi:k]). Grapheme- 
to-phoneme correspondence is more consistent in Swedish than, 
for example, English (Seymour et al., 2003) and few orthograph- 
ically dissimilar Swedish words rhyme. Therefore R-l-O— word 
pairs included low-frequency words and words from different 
open word classes (nouns, verbs, adjectives, and adverbs). Con- 
sequently, words for the other conditions were selected to match 
the R-l-O— words. Further, specific letter combinations can typi- 
cally only be pronounced in one way in Swedish. Swedish R— 0-1- 
word pairs thus have orthographically similar, but not identical, 
final syllables. Different strategies were adopted to create similar 
word-end gestalts: in most cases word-endings differed by one 
letter (e.g., sant - saft, [san:t] - [safrt]), in other cases letters were 
rearranged (e.g.,rost-fots, [ras:t] - [forts]), or added (e.g.,besked- 
beskydd, [be / e:d] [be / yd:] ). The variety of solutions reduced the 
predictability of the orthographic form of the second word in each 
pair and ensured the saliency of mismatch in the R— O-l- condi- 
tion. All rhyme task words were three to nine letters long, mono- 
or disyllabic and selected from the Swedish text corpus PAROLE 
(Sprakbanken, University of Gothenburg) ^ The distribution of 
mono- and disyllabic words, word classes and stress patterns was 
even over conditions and positions (prime word, target word) in 
word pairs. MANOVA with word length and word frequency as 
dependent variables, and condition (four levels: R-I-0-I-, R-l-O—, 
R— O-j-, R— O— ) and position (two levels: prime, target) as inde- 
pendent variables, showed that there were no differences in either 
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Table 1 1 Descriptive statistics of the word stimuli divided by condition. 



Condition Word length Word frequency 





M 


SD 


Range 


M 


SD 


Range 


R-hO-h 


4.97 


1.44 


6 


381.23 


762.91 


5259 


R-l-0- 


4.93 


1.22 


5 


400.57 


1075.00 


8582 


R-O-h 


4.85 


1.22 


6 


37794 


1028.00 


6521 


R-0- 


5.01 


1.32 


5 


382.61 


1160.10 


8448 



word frequency or word length over conditions or position (see 
Table 1 for descriptive statistics). The 192-rhyme task word pairs 
were pseudorandomized into a single list. No more than five "yes" 
(R-l-O-l- and R-j-O-) or "no" (R-O-l- and R-0-) answers, and 
no more than three consecutive trials from the same condition was 
allowed. 

PROCEDURE 

Rhyme judgment task 

E-prime software (version 2.0)^ from Psychological Software 
Tools, Inc., was used for stimulus presentation and collection of 
behavioral responses. Words were presented centrally on a 17" 
liquid crystal display computer screen in white lowercase letters 
against a black background. The horizontal visual angle of the 
word stimuli were 2.3-5.3°. Each trial began with a fixation cross 
displayed for 1000 ms. The fixation cross was followed by a 200-ms 
presentation of the prime word. An ISI of either 50 or 800 ms pre- 
ceded presentation of the target word. The target word remained 
on screen for 200 ms and 1000 ms after target word offset, a 
response probe appeared (see Figure 1). The task was to decide 
with a button press whether the words in each paired rhymed or 
not and from probe onset participants had 5 s to respond. In order 
to encourage a phonological strategy, participants were instructed 
not to pay attention to how words were spelled, but decide solely 
on basis of word pronunciation. The rhyme judgment list was pre- 
sented twice to all participants, once with short ISI and once with 
long ISI. Order of presentation was counterbalanced. 

ERP recording and analyses 

The EGI (Electrical Geodesies Inc., Eugene, OR, USA) Geodesies 
Net Amps system with 128-channel, Ag/AgCl electrode, HydroCel 
Geodesic Sensor Nets, a Net Amps 300 Amplifier and NetSta- 
tion software version 4.4.2 was used to acquire and analyze EEC 
data. The EEG was continuously recorded at a 250-Hz sampling 
rate and electrode impedances were kept below 50kS2. A vertex 
reference was used during acquisition. Offline, the EEG was 0.30- 
30 Hz bandpass filtered. The continuous EEG was segmented into 
epochs from 200 ms before either target onset (long ISI), or prime 
onset (short ISI), to 1000 ms post target onset. The longer epochs 
extracted in the short ISI ensured inclusion of a time-window 
for baseline correction that was free from ERPs elicited by the 
prime. Only trials with correct answers were retained for statisti- 
cal analyses. The NetStation Artifact Detection tool was then used 
to detect artifacts. Thresholds were set to ±100 |xV for eye blinks 
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1000 ms 

200 ms 




800 / 50 ms 
200 ms 



1000 ms 



response or 
5000 ms 



FIGURE 1 I The ERP paradigm. 



Table 2 | Mean number of segments, divided by condition and 
inter-stimulus interval (ISI), that were retained for analyses after 
exclusion of trials with incorrect answers and artifact contaminated 
segments. 



Condition 



Long ISI (800 ms) 



Short ISI (50 ms) 





M 


SD 


Range 


M 


SD 


Range 


R+0+ 


39 


6.85 


20-47 


38 


6.81 


22-47 


R+0- 


32 


8.15 


16-45 


32 


708 


17-45 


R-0+ 


36 


8.33 


19-47 


34 


9.15 


17-45 


R-0- 


41 


6.50 


20-48 


40 


701 


19-48 



and ±45 [xV for horizontal eye-movements. EEG channel thresh- 
olds were set to voltage changes larger than ±70 [iV within 150 ms 
intervals, or < 1 |xV within a segment. A channel was marked bad 
for the entire session if it was deemed bad in more than 20% 
of the trials. Segments containing more than 10 bad channels, 
eye-movements or eye blinks were rejected. The Bad Channel 
replacement tool was applied to interpolate bad channels in good 
segments, about 1.5% of the data, using spherical splines. All data 
were also visually inspected. Accepted segments were averaged in 
each condition, re-referenced to the average reference, and base- 
line corrected either over the 100-ms before target onset (long ISI), 
or over the 100-ms before prime onset (short ISI). Overall, 15% of 
segments, evenly distributed over the conditions, from correctly 
answered trials were excluded. The average number of artifact- 
free segments from correctly answered trials in each condition is 
displayed in Table 2. 

Six groups of electrodes representing frontal, centroparietal, 
and occipital areas in both hemispheres were chosen for statis- 
tical analyses based on previous literature and visual inspection 
of the waveforms. The electrode groups are displayed in Figure 2 
together with a table showing corresponding electrode numbers 
based on the 10-20 international system (for a more compre- 
hensive table of HydroCel Geodesic Sensor Nets - 10-20 system 
electrode number correspondences, see Luu and Ferree, 2000). 
Three consecutive time-windows were used for analyses: 100-300, 
300-500, and 500-700 ms post target word onset. Mean amplitude 
(mean voltage value in a time-window) and peak latency (time in 



III « , 



10-20 


Electrode 


System 


number 


F3 


24 


F4 


124 


P3 


52 


P4 


92 


01 


70 


02 


83 



» 
* 



m 



FIGURE 2 I A schematic view of the HydroCel Geodesic Sensor Net as 
seen from above with the nose up and neck down. The electrodes 
chosen for statistics extraction are shaded. The inserted table shows 
corresponding 20-10 system electrodes. 



ms from target word onset to the maximum amplitude point in a 
time-window) were extracted for each electrode in the electrode 
groups. In case the peak latency was recorded at, or close to, either 
borders of a time-window, waveforms were visually inspected to 
verify that the statistically identified peak was not part of a deflec- 
tion whose maximum amplitude fell outside the time-window. If 
it was, the latency to the second-to-maximum peak was manu- 
ally extracted. For each participant, time-window and rhyme task 
condition the resulting mean amplitude and peak latency values 
were then individually averaged across the six electrodes in each 
group. 

Statistical analyses 

Event-related potential mean amplitudes were analyzed by sepa- 
rate mixed ANOVAs conducted in each time-window (100-300, 
300-500, and 500-700 ms) and ISI (long, short). Rhyme (two 
levels: R+, R— ), orthography (two levels: 0+, O— ), antpos 
(three levels: frontal, centroparietal, occipital), and hemisphere 
(two levels: left, right) were entered as within-participants vari- 
ables and group (two levels: NH, HI) as between-participants 
variable. Peak latencies of the components of interest were ana- 
lyzed by mixed ANOVAs with the factors rhyme, orthography, 
and group in the topographic regions where the components 
had been identified as maximal by the omnibus ANOVA (e.g., 
right centroparietal). Separate follow-up ANOVAs for each group 
were conducted to verify presence of the N400. Greenhouse- 
Geisser correction was applied whenever Mauchly's test of 
sphericity was significant. Interactions were examined by pair- 
wise t-tests with Bonferroni correction for multiple compar- 
isons and effect sizes were computed for the pairwise com- 
parisons. The effect sizes were further used to help interpreta- 
tion of the data, i.e., as indicators of which topographic region 
was most sensitive to differences between conditions. Behav- 
ioral data (percent correct responses) were analyzed with separate 
three-way (rhyme x orthography x group) mixed ANOVAs for 
each ISI. 
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Table 3 | Means and standard deviations for the normal hearing (NH) 
and hearing-impaired (HI) groups on the cognitive tests. 



Test NH HI 





M 


SD 


M 


SD 


Reading span 


41.52 


8.88 


39.46 


10.14 


Word 


30.96 


1.58 


29.85 


2.87 


compreliension 










Non-word reading 


28.22 


9.00 


25.23 


6.90 


Orthograplnic word- 


51.89 


12.44 


44.92 


18.57 


pseudolnomophone 










discrimination 










Letter fluency 


30.85" 


8.29 


25.23" 


773 


Category fluency 


56.52 


11.86 


51.23 


8.76 


Digit span forward 


58.89 


10.01 


55.81 


10.59 



•p< 0.05. 



RESULTS 
COGNITIVE TESTS 

Group differences in performance were found on only one of 
the cognitive tests (Table 3). NH and HI were comparable on 
working memory capacity, phonological short-term memory, ver- 
bal ability, semantic verbal retrieval, phonological decoding, and 
orthographic decoding [fs(51) < 0.44, ps> 0.07, ns]. However, HI 
were outperformed by NH in phonemically based verbal retrieval 
as measured by the letter fluency task [t(51) = 2.55, p = 0.014]. 

RHYME JUDGMENT: BEHAVIORAL RESULTS 
Long ISI 

ANOVA resulted in main effects of both rhyme 51) = 18.67, 
MSE= 168.62, p< 0.001, 11^ = 0.27] and orthography [F(l, 
51) = 6.11, MSE= 105.10, p = 0.017,Ti2 = 0.11] in long ISI. More 
errors were made in response to rhyming word pairs than 
to non-rhyming word pairs and to orthographically dissimilar 
word pairs than to orthographically similar word pairs. There 
was also a rhyme x orthography interaction [F(l, 51) = 163.69, 
MSE = 68.50, p < 0.001, r]^ = 0.76]. As can be seen in Figure 3, 
more errors were made in the mismatching (R-j-O— , R— 0-I-) 
than in the matching (R-j-O-j-, R— O— ) conditions (ps< 0.001, 
rs > 0.69). Out of the two mismatching conditions, performance 
was lowest in R-l-O- [f(51) = 6.96, p< 0.001, r = 0.70]. There 
were no group differences. 

Short ISI 

A similar pattern of results, with more errors in the mis- 
matching than the matching conditions and more errors 
in R-j-O— than in R— 0-I-, was found in short ISI 
[main effect of rhyme, F{1, 51) = 6.50, MSE= 139.16, 
p = 0.014, T)^ = 0.1 1, and rhyme x orthography interaction, _F(1, 
51) = 154.09, MSE = 84.30, p < 0.001, Ti^ = 0.75, with ps < 0.001 
and rs > 0.46 in post hoc comparisons]. Further, perfor- 
mance differed between the two groups: HI made signifi- 
cantly more errors than NH in both mismatching condi- 
tions [rhyme x orthography x group interaction, ^(1, 51) = 4.73, 
MSE = 84.93, p = 0.034, Ti^ = 0.08, fR+o- (51) = 2.51, p = 0.015, 



r = 0.33, and fR_ o+(51) = 3.42, p = 0.001, r = 0.44inposf hoc 
comparisons] . 

The finding of lower performance by HI than NH in the 
mismatching conditions in short ISI, contrasting with similar 
performance in long ISI, indicates that HI could engage top- 
down processes, consuming more time than allowed by short ISI, 
to overcome phonological difficulties. The pattern of data (see 
Figure 3) further suggests it was primarily R— 0-|- performance 
that improved with the opportunity to employ explicit process- 
ing. In order to analyze benefit from long ISI, an index of change 
was computed by subtracting performance in short ISI from per- 
formance in long ISI in each condition. Results of one-sample 
f -tests showed significant improvement in R— 0-|- only, and this 
was the case for both groups. HI performance improved with 5% 
and that of NH by 3.5% [ tNH (26) = 2.49, p = 0.0 19, r = 0.44 and, 
fHi(25) = 2.24, p = 0.034, r = 0.41] but there was no difference 
between the groups. 

RHYME JUDGMENT: ERP RESULTS 

Grand average waveforms for all participants in long and short 
ISI are displayed in Figure 4. Figures 5 and 6 show the grand 
average waveforms and their topographical distribution for each 
group in long ISI, Figures 7 and 8 in short ISI. Overall, wave- 
forms showed an N170 at occipital sites, an early negativ- 
ity followed by a distinct N400 over the right centroparietal 
area and a left-lateralized frontal positivity (FP). Results of the 
ANOVA analyses including all participants are summarized in 
Table 4. Whenever electrodes have a corresponding 10-20 sys- 
tem label, that label is used below; otherwise the electrodes 
are labeled according to their HydroCel Geodesic Sensor Net 
number. 

100-300 ms latency window 

Long ISI. In the 100- to 300-ms time-window, ERPs showed an 
N2-like negativity that differed between conditions over the right 
centroparietal area (rhyme x orthography x antpos x hemisphere 
interaction). Its amplitude was significantly larger (more negative) 
as elicited by R— 0-|- than the other conditions (mean ampli- 
tudes across conditions: 0.65-0.94 |iV, SD: 1.02-1.27, ps < 0.001, 
rs = 0.46-0.54) while it was not sensitive to condition in terms 
of peak latency (mean peak latencies over conditions: 164- 
178 ms, SD: 31.64-36.50). The N2-like negativity was largest 
at P4 with a mean R— 0-|- amplitude of — 0.31(iV (as com- 
pared to R+0+, -0.02; R+0-, -0.16; R-0-, -0.08). Inter- 
estingly, the N2-like deflection in R— 0-|- was driven by HI 
[rhyme x orthography x hemisphere x group interaction, ^(1, 
50) = 4.58, MSE = 2.09, p = 0.037]. As displayed in Figure 9, 
amplitudes were significantly more negative in R— 0-|- than in 
R-O- over the right hemisphere for HI [("(50) = 4.60, p < 0.001, 
r = 0.42]. The absolute amplitude difference between the con- 
ditions was largest in the centroparietal electrode group, where 
it was most pronounced in electrodes Cp6 (Mr_o+ = 0.11 |xV, 
Mr_o- = 0.77 |xV, see Figure 9) and 86. By contrast, ERPs 
did not differentiate between conditions in NH. There were 
no group differences in right centroparietal peak latency [-Fs(l, 
50) < 0.715, ns]. 
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FIGURE 3 I (A) IVIean percent correct rhyme judgments as a function 
of hearing status and condition in short and long ISI. (B) Mean 
percent correct rhyme judgments collapsed over the rhyming {R+), 



Short ISI. InshortISI,;)osf/joc investigation of the highest order 
interaction (rhyme x orthography x antpos x hemisphere), foc- 
using on the N2-like negativity described above, showed that, 
although there was a similar, but more protracted, right cen- 
troparietal negative deflection in short SOA, amplitudes were not 
sensitive to condition (mean amplitudes across conditions: 0.00- 
0.11 |xV, SD: 1.72-1.86; ps > 0.191, ns). Neither were right cen- 
troparietal peak latencies [mean peak latencies across conditions: 
167-175 ms, SD: 44.28-49.08; Fs(l, 50) < 1.30, ns]. 

These results were in support of our hypothesis that HI is asso- 
ciated with enhanced N2-like responses. The effect was seen only 
in long ISI, that is, where the behavioral performance of HI was 
on a par with that of NH. 

300-500 ms latency window 

Long ISI. As expected, there was a distinct N400 over the right 
centroparietal area in this time- window (rhyme x orthography x 
antpos X hemisphere interaction). The N400 was significantly 
larger (more negative) the more incongruent the condition: 
R— O— > R— 0-|- > R-j-O— > R-j-O-j- (mean amplitudes across 
conditions: 0.50-2.17 (iV, SD: 1.40-1.57, ps< 0.001, rs = 0.55- 
0.81). The amplitude differences between R— O— and R-j-O-j- 
was largest at electrode Cp4 with mean amplitudes of 
—0.06 and 1.98 (xV respectively. Peak latencies were signifi- 
cantly shorter for rhymes than non-rhymes [MRi,ymes = 371 ms, 
SD = 40.24, MNon-rhymes = 394 ms, SD = 35.33, _F(1, 51) = 26.97, 
MSE= 1060.30, p< 0.001, r\^ = Q35]. The N400 continued 
over bilateral occipital sites, but here it did not dif- 
fer between the two non-rhyming conditions, such that 
R-O- = R-0+ > R+O- > R+0+ (ps < 0.001, rs = 0.49-0.75). 

Follow-up ANOVAs showed that the N400 was sensitive to 
rhyme and orthography in both groups with more negative ampli- 
tudes in response to non-rhyming and orthographically dissimilar 
word pairs, respectively (main effects of rhyme and orthography, 
ps < 0.035, T)^ = 0.28-0.68). Both groups also showed longer N400 
latencies in the non-rhyming conditions [main effect of rhyme. 



non-rhyming (R— ), orthographically similar (0-1-) and orthographically 
dissimilar (0—) conditions, all participants, in short and long ISI. Error 
bars represent 95% CI. 



Pnh(1, 26) = 15.62, MSE= 1131.96, p = 0.001, Ti^ = 0.38; f hi(1, 
24) = 10.84, MSE= 1011.90, p < 0.003, r]^ = 031; mean peak 
latencies across conditions: 366-403 ms, SD: 37.27-54.52]. How- 
ever, there were no group differences in either N400 amplitudes or 
peak latencies [fs(l,50) < 1.25, ns]. 

In the left frontal electrode group, ERPs showed a differ- 
ent pattern. As can be seen in Figures 4 and 5, an extended 
positivity in response to the non-rhyming conditions, partic- 
ularly R— O— , starts differentiating between conditions from 
around 400 ms such that R-j-O-j- = R-j-O- < R-O-j- < R-O- 
(ps< 0.002, rs = 0.41-0.92). 

Short ISI. In short ISI, an N400 effect differentiated between 
rhymes and non-rhymes over all right hemisphere sites 
(rhyme x antpos x hemisphere interaction, ps < 0.001, rs = 0.62- 
0.69). The largest effect size and mean amplitude difference 
was measured in the centroparietal area (MRhyme = 0.88 |iV, 
SD= 1.90, MNon-rhyme = 0.15 |xV, SD= 1.79). Right centropari- 
etal N400 peak latencies were also sensitive to condition, being 
longer in response to non-rhyming than rhyming, and ortho- 
graphically dissimilar than similar target words [main effect 
of rhyme, f(l, 51) = 24.78, MSE = 871.93, p < 0.001, y]^ = 033; 
main effect of orthography f(l, 51) = 14.73, MSE = 894.91, 
p < 0.001, Ti2 = 0.22; mean peak latencies across conditions: 371- 
408 ms, SD: 40.46-44.04]. The N400 was present in both NH 
and HI (main effects of rhyme, ps< 0.019, ti^ = 0.20 and 0.60, 
respectively) and peak latencies were shorter in the rhyming and 
orthographically similar conditions in both groups (main effects 
of rhyme and orthography, ps < 0.025, = 0.20-0.30). 

Like in long ISI, a left FP in response to phonological incongru- 
ence onset at around 400 ms and was significantly more positive 
in the non-rhyming than the rhyming conditions [f (104) = 2.96, 
p = 0.004, r = 0.28]. 

To summarize, a distinct N400 response was elicited by the par- 
adigm but, contrary to our hypothesis, it did not differ between 
groups in either ISI. 
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FIGURE 4 I Grand average ERP waveforms elicited by R+0+, R+O— , R— 0+, and R— O— target words in long and short ISI, all participants. Tlie sliaded 
areas mark tlie 100-300, 300-500, and 500-700 ms time-windows, respectively. 
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FIGURE 6 I Topographical distribution of tPie grand 
averaged ERPs in the normal hearing (NH) and 
hearing-impaired (HI) groups in the 100-300, 300-500, and 



500-700 ms time-windows, long ISI. The rows show the 
distribution over the R+0+, R+0-, R-0+, and R-0- rhyme 
task conditions. 



500-700 ms latency window 

Long ISI. In this later time-window, waveforms showed a distinct 
left FP in response to incongruency and a continued N400 over 
the right centroparietal area (rhyme x orthography x antpos x 
hemisphere interaction). Post hoc tests showed that amplitudes 
over the left frontal area were significantly more positive in 
response to the non-rhyming than the rhyming conditions, and 
more positive in response to R— O— than R— 0-|- (ps < 0.001, 
rs = 0.76-0.94, mean amplitudes across conditions: —0.07 to 
2.18 |xV, SD: 1.84-2.16). The largest amplitude difference was 
measured at FC5 where mean amplitudes were —0.18 and 2.47 (iV 
in R-l-O— and R— O— , respectively. The positivity was also sensi- 
tive to condition in terms of timing: peak latencies were longest 
in the R-O-l- condition (M= 603 ms, SD = 51.04) and short- 
est in R-l-O-l- (M= 586 ms, SD = 54.96), a difference that was 
significant [rhyme x orthography interaction, _F(1, 51) = 5.45, 
MSB = 1842.73, p = 0.024; post hoc R+0+ versus R-O-l- com- 
parison, t(51) = 3.05, p = 0.004, r = 0.40]. 

In the right centroparietal area, amplitudes remained more neg- 
ative in response to the non-rhyming than rhyming conditions 
ips < 0.001, rs = 0.67-0.83) but no longer differentiated between 
R-l-O-l- and R-l-O—. In contrast to the previous time-window. 



ERPs were most negative in response to R— 0-|- (R-O-l- versus 
R— O— , p < 0.001, r = 0.47) suggesting a prolonged N400 effect 
to R-O-l- target words. There were no group differences in ERP 
amplitudes or peak latencies in this time-window. 

Short ISI. In short ISI, waveforms showed a similar, but less 
extended, positivity in response to incongruence over left frontal 
electrodes (rhyme x orthography x antpos x hemisphere inter- 
action). As in long ISI, the positivity was larger in response 
to non-rhymes than rhymes, and in response to R— O— than 
R-O-l- (mean amplitudes across conditions:— 0.07 to 1.33 plV,SD: 
1.82-2.07; ps < 0.001, rs = 0.48-0.90). Peak latencies were some- 
what shorter than in long ISI, around 515 ms (R— O— , M = 512, 
SD = 43.62; R-0+, M = 518, SD = 46.65). ANOVA conducted 
on left frontal peak latencies resulted in a rhyme x orthography 
interaction [F{1, 51)= 10.04, MSE= 1096.53,^ = 0.003]. Laten- 
cies were significantly longer in response to R— O— than the other 
conditions (ps < 0.001, rs = 0.39-0.54) but were not sensitive to 
group. 

The N400, i.e., more negative amplitudes in response to non- 
rhymes than rhymes in the right centroparietal area, continued 
into this time-window (ps< 0.001, rs = 0.63-0.90). There 
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FIGURE 7 I Grand average ERP waveforms elicited by R+0+, R+0— , R— 0+, and R— O— target words in each group, short ISI condition. Tine sliaded 
areas mark the 100-300, 300-500, and 500-700 ms time-windows, respectively. 
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FIGURE 8 I Topographical distribution of thie grand 
averaged ERPs in the normal hearing (NH) and 
hearing-impaired (HI) groups in the 100-300, 300-500, and 



500-700 ms time-windows, short ISI. Tlie rows slnow the 
distribution over the R+0+, R+0-, R-0+, and R-0- rhyme 
task conditions. 



was a significant rhyme x group interaction [F{1, 51) = 6.70, 
MSE = 2.91, p = 0.012] in ERP amplitudes: in NH participants 
ERPs no longer differentiated between rhymes and non-rhymes 
while there was a trend toward a continued differentiation in the 
hearing-impaired group [f(51) = 2.02, p = 0.048, r = 0.27, ns after 
Bonferroni correction]. 

The main finding in this time-window was that the rhyme 
judgment paradigm elicited a left FP, sensitive to phonology 
and showing an additive effect of phonological and orthographic 
incongruence in non-rhymes. 

DISCUSSION 

The present study investigated how HI affects the neural correlates 
of phonological processing. ERPs of participants with moderate- 
to-severe postlingually acquired HI and NH were registered during 
a visual rhyme judgment task with matching and mismatching 
orthography. The ISI was manipulated to examine behavioral 
performance and ERP correlates under conditions more or less 
conducive to employment of explicit processing. Behaviorally, the 
hearing-impaired participants performed worse than the NH par- 
ticipants in the mismatching rhyme judgment conditions when 
there was less time to engage top-down processes (short ISI). 



However, when such strategies could be more readily employed 
the hearing-impaired participants performed on a par with the 
NH participants (long ISI). Further, ERP results showed an ampli- 
fied N2-like response, specific to the participants with HI and long 
ISI, in the rhyme judgment condition in which they benefited the 
most from long ISI. 

BEHAVIORAL RESULTS 

Previous studies using similar material but with simultaneous pre- 
sentation of the words in each word pair (Andersson and Lyxell, 
1998; Lyxell et al., 1998; Andersson, 2002) have typically found 
that hearing-impaired participants fall behind participants with 
NH in visual rhyme judgments. It was therefore somewhat sur- 
prising that the groups performed on a par in long ISI in the 
present study. It is not unlikely that the hearing-impaired partic- 
ipants benefited from the explicit instruction to make decisions 
based on word phonology alone and the use of sequential, rather 
than simultaneous, presentation of the words in each pair in 
the present design. Fewer errors with sequential than simulta- 
neous presentation, especially for non-rhyming pairs, have been 
reported previously (Johnston and McDermott, 1986). In addi- 
tion, there was no difference between groups in non-word reading 
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FIGURE 9 I (A) Grand average ERP waveforms at electrode Cp6 and (B) nnean amplitudes in the right hemisphere elicited by R+0+, R+0— , R— 0+, and 
R— O— target words in the 100- to 300-ms latency window, long ISI, divided by group. Error bars represent 95% CI. 



which indicates that our hearing-impaired participants had rel- 
atively good phonological decoding abilities. With this in mind, 
they still made significantly more errors than the NH participants 
in both mismatching conditions in short ISI, that is, when there 
was less time to deploy top-down processing to aid performance. 
They also performed significantly worse than the NH participants 
in the test of phonemically based verbal retrieval, results that are in 
line with the research indicating that auditory deprivation may be 
associated with degraded phonological representations. With long 
ISI and more time to engage top-down strategies, rhyme judg- 
ment performance between groups was equalized. It was also in 
long ISI that the hearing related enhanced N2-like negativity was 
found. 

ERP RESULTS 

100-300 ms latency window 

N2-like negativities in response to phonological and/or ortho- 
graphic processing in silent reading have been reported in several 
studies (Niznikiewicz and Squires, 1996; Proverbio and Zani, 2003; 



Newman and Connolly, 2004; Simon et al., 2004; Martin et al, 
2006; Vissers et al, 2006) and are thought to reflect processes 
related to sublexical detection of conflict between outputs of 
orthographic/phonological analyses or violation of orthographic 
form expectations. The finding of an N2-like negativity sensitive to 
condition in the hearing-impaired group in the present study was 
in accordance with our hypothesis. Long-term acquired hearing 
loss in the moderate-to-severe range is known to affect phono- 
logical processing and compromise rhyme judgments when there 
is no support from orthography. Extra allocation of resources, 
reflected by an enhanced N2-like negativity, at detection of mis- 
matching phonological and orthographic cues fit in under these 
circumstances. To our knowledge this is the first time such an 
effect has been reported in individuals with HI; as noted in the 
introduction, little attention has hitherto been given to investi- 
gating the effect of acquired hearing loss on the neural correlates 
of phonological processing. A similar N2-like effect has however 
recently been reported in individuals with dyslexia, another pop- 
ulation which has been suggested to have specific problems with 



www.frontiersin.org 



May 2013 | Volume 4 | Article 241 | 13 



Classon et al. 



Early ERP signature of hearing 



Table 4 | Statistics for all effects of the ANOVAs conducted on mean amplitudes in the three time-windows analyzed. 



Condition 



Effect 



Time-window 









100-300 ms 




300-500 ms 




500-700 ms 






F 


P 


F 


P 


F 


P 


1 nnn 191 
1 1 y J o 1 




0 14 




35 60 


<0 001 


730 


<0 01 




0 


2.69 




2.63 




11.07 


<0.01 






14.77 


<0.001 


1.61 




15.23 


<0.001^ 




H 


18.64 


<0.001 


12.63 


0.001 


3.74 






R X 0 


0.76 




6.00 


<0.05 


9.53 


<0.001 




R X A 


0.33 




25.74 


<0.001^ 


50.90 


<0.001^ 




OxA 


5.66 


<0.05^ 


723 


<0.01^ 


0.55 






R V O X A 

1 I y\ \^ ^ 


1.63 




0.04 


ns 


0.62 






R X H 


2.71 




55.50 


<0.001 


36.41 


<0.001 




0 X H 


0.06 




22.88 


<0.001 


1.34 






R X O X H 

1 I /\ V-/ /\ 1 1 


1.66 




16.26 


<0.001 


22.49 


<0.001 




A X H 


3.37 


<0.05 


10.69 


<0.001 


15.94 


<0.001 




R X A X H 


0.02 


ns 


25.36 


<0.001 


24.12 


<0.001 




O X A X H 


4.60 


<0.05 


11.84 


<0.001 


4.90 


<0.01 




R V f) V A V H 


3.41 


<0.05 


1760 


<0.001 


13.42 


<0.001 


Ol lUI L lO 1 


p 


1 83 




1750 


<0 001 


1717 


<0 001 




0 


3.19 




1.92 




0.66 








50.51 


<0.001 ^ 


9.49 


<0.01^ 


10.64 


0.001^ 




H 


2.21 




52.83 


<0.001 


39.91 


<0.001 




R X 0 


4 16 


<0 05 


4 95 


<0 05 


21 85 


<0 001 




R X A 


0.37 




1.02 




30.12 


<0.001^ 




OxA 


1.09 


ns 


2.26 


ns 


0.62 


ns 




R X 0 X A 


1.25 


ns 


0.58 


ns 


2.63 


ns 




RxH 


0.31 


ns 


54.35 


<0.001 


49.14 


<0.001 




0 X H 


4.62 


<0.05 


24.60 


<0.001 


0.66 


ns 




RxOxH 


1.71 


ns 


3.60 


ns 


10.90 


<0.01 




Ax H 


1.71 


ns 


727 


0.001 


2708 


<0.001^ 




RxAxH 


1.86 


ns 


5.59 


<0.01 


23.39 


<0.001 




Ox Ax H 


0.04 


ns 


0.96 


ns 


0.06 


ns 




R X 0 xAx H 


4.50 


<0.05 


2.72 


ns 


5.81 


<0.01 



R, rhyme: 0, orthography; A, antpos; H, hemisphere. 
" Greenhouse-Geisser correction. 



phonological representations and processing (Swan and Goswami, 
1997; Elbro and Jensen, 2005; Ziegler and Goswami, 2005; Boada 
and Pennington, 2006). Savill and Thierry (2011) conducted a 
study where they used homophonic and non-homophonic pairs 
of non-word primes and word targets that were orthographi- 
cally similar or dissimilar (e.g., the primes horce, hauce, horle, 
or hiele presented before the target word HORSE). The task 
was to decide whether prime and target sounded the same or 
not. Dyslexic participants showed significantly more negative 
potentials than controls in response to orthographically simi- 
lar non-homophones (e.g., horle-horse, comparable to R— 0-|- 
in the present study) than to orthographically dissimilar non- 
homophones (e.g., hiele-horse, comparable to R— O— ) in a 150- 
to 220-ms time-window. Thus, individuals with dyslexia and 
HI both show a neural sensitivity to orthographic similarity in 
phonologically different stimuh in visual phonological judgment 



tasks that is not found in individuals with intact phonological 
abilities. 

In the present study, a phonological strategy was actively 
encouraged not just by the task itself, but also by the explicit 
instructions to make judgments based on how words sound and 
the consecutive (as compared to simultaneous) presentation of 
words within pairs. In rhyme judgments with long ISI, a phono- 
logical strategy leads to generation of an expectancy set involving 
lexical candidates that rhyme with the first word. Thereby, judg- 
ment of rhyming word pairs is facilitated (Hillinger, 1980; John- 
ston and McDermott, 1986) to a degree that can override the effect 
of conflicting orthography (Baum and Leonard, 1999; Savill et al., 
201 1). This is likely the reason why there was no N2-like enhance- 
ment in response to orthographically dissimilar rhymes, in spite 
of the presence of misleading orthographic cues. By contrast, in 
orthographically similar non-rhymes, phonological expectancies 
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are always violated: the second word never rhymes with the first 
word. Hence, predictions have to be abandoned and rapid access 
made to the phonology of the second word. Indeed, several stud- 
ies have found longer reaction times and/or lower accuracy in 
R— 0+ than R+O— conditions (Polich et al, 1983; Johnston and 
McDermott, 1986; Kramer and Donchin, 1987; Rugg and Barrett, 
1987; Liiidcll and Lum, 2008) indicating that the processing load 
generated by conflicting cues is largest when different phonolog- 
ical codes need to be derived from similar orthographic patterns 
(Webcr-rox ct al, 2003). 

We had expected that the poorer quality phonological repre- 
sentations associated with moderate-to-severe HI would interfere 
with implicit spreading of activation mechanisms as reflected by 
ERP deviations in short ISI, but this was not the case. Being aware 
of the problem with overlapping components in short ISIs (where 
responses elicited by a stimulus have not ended before a second 
stimulus is presented) and the concomitant risk of missing effects, 
it also needs to be noted that we chose to analyze correct answers 
only. In other words, our results showed no group difference in 
the neural correlates of successful identification of rhyme status 
in short ISI. Instead we found a pattern where behavioral perfor- 
mance benefited from long ISI specifically in the R— 0-|- condition, 
in which performance of the hearing-impaired group was on a par 
with the NH group in long (but not short) ISI, and a hearing 
related N2-like negativity enhanced only in R— 0-|- in long ISI. 
This pattern of results suggests the enhanced N2-like negativity in 
the hearing-impaired group is part of a compensatory strategy. 

Functional Magnetic Resonance Imaging studies examining 
rhyme judgment in congenitally deaf and/or dyslexic adults have 
found increased activation in the left IFG, suggested to reflect com- 
pensatory use of spelling-to-sound procedures and fine-grained 
articulatory recoding (e.g., Aparicio ct al., 2007; MacSwceney 
et al., 2009). The role of articulatory recoding in this task is 
also demonstrated by behavioral findings of the disruptive effect 
of articulatory suppression on visual rhyme judgment (Johnston 
and McDermott, 1986; Brown, 1987; Tree et al, 2011), particu- 
larly for orthographicaUy similar non-rhyming word pairs (John- 
ston and McDermott, 1986). Thus, it is likely that in this study 
too, articulatory recoding and grapheme-to-phoneme conversion 
are examples of strategies used by the hearing-impaired partici- 
pants to compensate for phonological processing difficulties. Such 
strategies would lead to an enhanced precision of the representa- 
tion, orthographic, and/or phonological, of the first word. In turn, 
this would facilitate detection of mismatch at presentation of the 
second word. 

In short ISI there was no time to employ such strategies, 
increasing the risk of being misled by the orthographic similarity. 
Indeed, the increased responsiveness to visual, rather than sound- 
based language cues found in individuals with acquired HI (Lee 
et al, 2001, 2007; Champoux et al, 2009) is likely to lead to a 
higher reliance on orthography in this text-based task. This would 
make the hearing- impaired participants more vulnerable to ortho- 
graphic interference in both mismatching conditions in short ISIs, 
which is in line with the results presented here. 

Parietal N2-negativities elicited by orthographic/phonological 
mismatch in silent reading paradigms are often left-lateralized 
(Niznikiewicz and Squires, 1996; Newman and Connolly, 2004; 



Simon et al., 2004). However, this is not always the case (Mar- 
tin ct al., 2006). Bearing in mind that the scalp distribution of 
ERPs is not necessarily a reliable indicator of underlying neu- 
ronal generators, the right lateralization of the N2-like effect in 
the hearing-impaired participants in the present study is inter- 
esting in view of recent fMRI data. Lazard et al. (2012) found 
right PSTG/SMG overactivation in individuals with postlingually 
acquired hearing loss during visual rhyme judgments. The present 
result is compatible with their hypothesis that auditory deprivation 
is followed by functional reorganization in the form of increased 
recruitment of right temporal areas in phonological processing. 
On a more speculative note, it has also been shown that ortho- 
graphic processing is a right hemispheric strength. For example, 
visual half-field studies indicate that the right hemisphere is supe- 
rior to the left hemisphere for orthographic matching tasks, and is 
able to make non-rhyme decisions based on orthographic analysis 
(for a review of right hemispheric language processing abilities, see 
Lindcll, 2006). The distribution of the N2-like effect in the present 
study might thus be related to a stronger reliance on orthography 
in making the rhyme decision. 

300-500 ms latency window 

Contrary to our hypothesis, we found no hearing related N400 

deviations in either mean amplitude or peak latency. In view of 
the group interaction that emerged in the earlier time-window, 
the lack of N400 differences is not likely to be caused by lack 
of power. Further, an N400 was clearly elicited by the paradigm: 
in long ISI, the component differed between all four conditions, 
showing the same additive effect of phonological and orthographic 
incongruity as previously reported in the literature. The compo- 
nent distinguished between rhymes and non-rhymes, and between 
orthographicaUy similar and dissimilar word pairs, in both groups. 
Hence, nor is the lack of group effects likely to be caused by factors 
related to the stimulus material. This is worth noticing: as far as 
we know, this is the first ERP study using written Swedish word 
pairs in a rhyme judgment task with matching and mismatching 
orthography. 

Although there are problems with interpreting nuU effects, 
the present results indicate that while early, sublexical phono- 
logical level processes are affected by acquired HI, later, phono- 
logical/lexical level processes proceed normally. If, as suggested 
above, top-down processing promote early detection of phono- 
logical/orthographic incongruency, it is reasonable that there is 
no deviancy in the later N400 component which is driven pre- 
cisely by incongruence. The result is also in line with previous 
research suggesting that phonological processing in individuals 
with postlingual auditory deprivation is less divergent than that of 
dyslexics (Lyxell et al., 2003). For comparison, Savill and Thierry 
(2011) found that early N2 anomalies in dyslexic participants 
were followed by ERP deviations well into later time-windows, 
including the P600 (SaviU and Thierry, 2011). 

500-700 ms latency window 

The N400 continued into this later time-window, particularly as 
elicited by orthographicaUy similar non-rhymes. This prolonged 
N400 is consistent with the suggestion above that R— 0-|- is the 
most challenging rhyme condition. In this time-window there was 
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a rhyme x group interaction in short ISI but as post hoc proce- 
dures showed there was no reliable effect of rhyme in either group 
we refrain from discussing it further. 

A P600 was not elicited by the present paradigm; instead, ERPs 
showed a distinct left FP in response to non-rhymes, and par- 
ticularly non-rhymes that were also orthographically dissimilar, 
in both groups and ISIs. This component is very similar to a FP 
reported in studies using sentences with more or less predictable 
endings (DeLong et al., 2011, 2012; Thornhill and Van Petten, 
2012; Van Petten and Luka, 2012). The FP differs topographi- 
cally from the P600 which is typically largest at centroparietal 
scalp sites. Further, there is now general consensus that the P600 
is related to reprocessing cost, i.e., continued analysis or reanalysis 
of, for example, problematic sentences. The FP is as yet much less 
studied but has been suggested to reflect processes invoked when 
specific prediction of an upcoming word is disconfirmed (DeLong 
et al, 2012; Thornhill and Van Petten, 2012; Van Petten and Luka, 
2012). Similar to the N400, the FP has been found to be smaller 
for highly predictable sentence endings than for less predictable 
sentence endings. Unlike the N400 its amplitude seems insensi- 
tive to the semantic similarity between an unexpected and highly 
expected sentence ending. Hence, while the sensitivity of the N400 
extends to a conceptual level, the FP seems driven more exclusively 
by the appearance of an unpredictable word (Thornhill and Van 
Petten, 2012). The present observation of a FP is interesting; to 
our knowledge there are no previous reports of it being elicited in 
designs using word pairs and a phonological judgment task. How- 
ever, our results are compatible with previous findings that the FP 



is sensitive to specific expectations at a lexical level (Thornhill and 
Van Petten, 2012). 

CONCLUSION 

To summarize, the present results show an early ERP signature 
of acquired HI in visual rhyme judgment. The signature takes 
the shape of an N2-like negativity sensitive to orthography in 
non-rhymes. It was only elicited when there was time to recruit 
explicit processes and performance of the hearing-impaired par- 
ticipants was on a par with that of the NH. We therefore sug- 
gest it reflects compensatory top-down processing, probably via 
increased reliance on articulatory recoding and grapheme-to- 
phoneme conversion procedures. Such strategies likely enhances 
the precision of a phonological/orthographic representation held 
in working memory and facilitates detection of mismatch at an 
early, sublexical level at the stage of comparison to a second rep- 
resentation. The right parietal topography of the N2-like effect 
supports recruitment of right temporal areas for phonological 
processing following auditory deprivation. In the condition where 
there was not enough time for employment of top-down strate- 
gies, HI was associated with reduced rhyme judgment ability 
when phonology and orthography gave conflicting cues. This is 
suggested to reflect a higher reliance on visual, rather than sound- 
based, linguistic information and, thus, an increased vulnerability 
to orthographic interference. Taken together, these results pro- 
vide further insight into the mechanisms by which engagement of 
explicit functions support language processing when audition is 
compromised. 
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